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AUTOMATED COLLABORATIVE FILTERING IN WORLD WIDE WEB ADVERTISING 

Technical Field and Industrial Applicability 
This invention involves the display of advertising to users of an interactive 

communications medium It is particularly useful with the World Wide Web, which utilizes a 

communications protocol on the Internet 

To access the Internet, and to carry out the methods described in this document, one 

must have a CPU, RAM. Internet connection (for instance, through a phone Une and modem). 

input device such as a keyboard, and an output device such as a TV, CRT or LCD. 

All of the above-identified hardware, necessary to carry out the steps described in this 

document, wiU be considered to be impHed in the following description of the present invention 



Background Art 

Under the old model for the advertising industry, the subject matter of one "unit of 
publication" (a magazine, a newspaper section, a radio show, a TV show) was often the sole 
means an advertiser possessed in order to guess the interests of a particular reader or viewer. If 
for instance, the magazine was about cars, advertisers knew that anyone reading it was highly 
likely to be interested in cars. 

However, on the Internet's World Wide Web. mulUple units of publication— that is, 
multiple Web pages and user actions over time-can be used to determine the interests of each 
individual. Moreover, this information can be gathered very inexpensively. To do this, we take 
advantage of the fact that a Web user's actions can be tracked over time. This rich source of 
information about each person wiU be used to bring about an era of far more efficient 
advertising. The information used includes not only which sites were visited by the user and for 
how long, but also which ads the user clicked on. as well as other information. 

Under the old model, as it exists on the Web today, most of this information is ignored. 
It is technically possible to acquire it, but it Un't generally being done. This is due to reasons of 
momentum of the old model, lack of well-known software and statistical tools for making use of 
the information, and, not insignificantly, fears of an invasion of privacy (a problem that must be 
dealt with and that this concept paper will explore below). But this information, when acquired 
and used, will be extremely useful in trying to make sure that each square inch of the limited 
Web advertising space on each site is used to efTectively reach individual customers. 

This ignored information, because of its power to enhance advertising effectiveness, is 
extremely valuable. 

Moreover, the use of this information benefits not only the users, but also every one of 
the interested commercial entities-advertisers, ad agencies, and Web sites. Each entity will be 
economically motivated to facilitate the move to the new paradigm. 



such as an Netscape-style in-hne plug-in. a Screensaver working in conjunction with the Web 
browser, or the Web browser itself, is used to tie the data together 

This information b used as the basis for calculations which generate a (usually numeric) 
measure of similarity between individuals. Examples of such similarity measures are 
well-known to programmers of ordinary skill in the field of coUaborative filtering. 

The individuals with the greatest calculated similarity become the subject's community 
In one embodiment clusters are formed of groups of very similar consumers. Then the 
subjects community consists of all or some of the other members of his cluster. 

The next major task is to decide what ads to show the subject based on his community. 
In one embodiment of the invention, a new ad is displayed randomly or on a fixed 
schedule to a certain number of users. During this training period" for the new ad. a certain 
percentage of the members of the subject's community will dick on it. If this is an unusuaUy 
high proportion, then there is a relatively high likelihood that the ad will be of relatively high 
interest to the subject. In one embodiment, statistical techniques are used to determine a 
probability, associated with a fixed confidence level, with which we can assume a 
randomly-chosen member of the subject's community wiU tend to dick on the ad; this 
probability is used as the measure of similarity. Other embodiments involve other analytic 
techniques. 

There are a number of additional features found in other embodiments of the invention. 
In one embodiment, the advertiser spedfies the demographic profile he wants to show 
the ad to. In that case, as long as we have demographic information available for some 
consumers, the system targets ads by considering the subject s community members who have 
supphed demographic information. For instance, by computing the average age of the members 
of the subject s community who have supplied their ages, the system is enabled to make an 
-inteUigent guess" about the subject's age. and use that guess for the purpose of targeting ads. 

In one embodiment of the invention, spedal Web pages or sites are supplied whid» 
enable advertisers to spedfy spedfic spedfic sites they would Uke their ads to run on (or not run 
onn similarly, spedal Web pages or sites are suppUed whid» enable Web site administrators to 
spedfy ads they would like to display or not display. 

In other embodiments, means are supplied for consumers to spedfy and update their 
demographic information; these means take the form of a Web site or page in one embodiment, 
and software running on the consumer's computer in another. ^ 

In some embodiments, software running on the consumer s computer makes the choices 
about whKh ads are to be displayed for that user. This embodiment has the advantage that it 
obviates the need for a central database storing detailed information about consumer together 
with an identifier for eadi consumer; so the consumer's privacy is protected. 
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Modes for Canying out the Invention 
Smart Ad Boxes 

l*o<«.«n»ec..fthi.tav«,a.„«U,e-SmmAdB„.- A Smart iU Box is a„ .„ 

Web page can Biiiiultaii«Mly,«. different ads. ™»i»toa 

A nun.b,r can be used by tt,e «,ftw.re in d«e™ining which ads .. ah«. F.r 

.»..ce, ha.., on Beceniher 6. 1995 press release. U,e c«„pany C,N« appear. 
PUmnng u, unple.„>„t a Smart Ad Bex-lilce „aten, which decide, which ad. u. ZLt «l«.K 
«~r» based «. such .nib™«i.n as «.e .,p. .r Web brewser U^r. «aing,tl^nr^ 
^ domain <KDU. CO^ e... and ^ d^nagraphic inTarmaJToelr 
release ^ N,™ Mali. Or^p iadic.. la,.. „^ aimita, phn. 

in ^ "'"f" '"""^ ""^ "Uaberaa™ fttlMing (ACP) rttter in«..d of 
i^.men..n«. »chni,„.s. ,ACF ..... „fer„d . as ...... inf.rma«.n 

A^ f« a. .s hnewn. ftere is n. pr„r „ ,„„^„ „^ ^^P in d««mi„i„g 
Which ads to show to whom. 

For ease of discussion, this patent will focus exclusively on the use of ACF in Web 
^rt^ing. However, it must be stressed that ACF can be used in a complementary manner to 
teduu^ues such as those C|Net and Novo Media Group are developing. ACF can give us a 
certam amount of evidence that a particular ad should be shown to a particular user; such 
information as age. sex. Internet domain, etc can be considered as weU 

of a . !r '""'"'"'^ * ^^'^ "^^-^ - Smart Ad Box. the Smart Ad Box consists 
Of a small amount of HTML code. ,t may optionally involve non^HTML code, such as Java U 
involves calling a CGI routine. 
What the user sees. 

is tarJTj! .^r" °" * ' that peg. wi.. «. an ad which 

» targe.^, u, U«. particute naer. Th«.. .imnhaneaas of th. „m. p.g. ^, ^ 

^Ud With different ad.. ad . vi.naU, conUined h, U.. Smart Ad LI. ^ stl Ad 
^.^.^m^ h. recungn... i„ , ^ ^^^^^ 

B« »in Pre-nt different ads .. a u.., „er time. Certainly, .i„p,y 
*«.ng the «u„. ad .,er and ever again i, „.t maxim...y effective. wou.d simply 

b«om. U, it and „.„M «,.rerore com. t. igner. it. Th» invenUen involve, rotating the 
-through different ads Which ar. oLiMy to be ofinterent. that particnia, user I 
«.-H.n sy^, can be cho«n for maxima, overall adverti^ng effectivene... One wny u. 
me-ur. effectiven«,. wouM b. the tr^^ .f .„ck. .n ad. in Smart Ad Box..-«„ 
sohedu.. couh. be choeen to maximixe this number. It couid invo..e such inibrmatio. asT 
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number of times the user has seen each ad in the past, and the predicted likelihood that the 
user will be interested in the given ad. Another factor that could be considered is resonance 
with the Web page showing the ad— perhaps ads that relate in some way to the subjea matter 
of the page will be more likely to be clicked on. 

Like most current Web advertisements, clicking on a Smart Ad Box will cause the user 
to be transported to a Web site chosen by the advertiser. 

Moreover, particular implementations of the present invention can optionally include 
certain additional features, such as the ability to r^ject an ad— for instance, with an option-dick 
of the mouse. A user would do this for an ad that had no interest for him. The rejected ad 
would automatically be replaced with another ad targeted to that user. 

Control features for advertisers and Web site managers. 

The central database can optionally contain rules or control records provided by 
advertisers and Web site managers. These couM be used for the following purposes: 

• An advertiser may not want to be associated with certain Web sites or types of 
Web sites; alternatively there may be certain sites or types of sites they would like to be 
associated with as strongly as possible. Advertisers could specify such inclinations, and they can 
be stored in a database. Then, when the software is dtoosing the next ad to show to a particular 
user who is visiting a particular Web site, those factors can be taken into account. 

• Similarly, a Web site may prefer certain advertisers or advertisements or ^rpes 
of advertisements to others. The Web site can specify such inclinations, and they can be taken 
into account when the next ad is dwsen for a particular user currently visiting that Web site. 

One way for advertisers and Web sites to supply these rules would be for a Web site to 
be constructed which would do the following: 

1 There would be a page whidi would present advertisers with a list of Web sites 
which are currently running Smart Ad Boxes. (Optionally, these Web sites could be grouped 
according to subject matter. For instence, Web sites concerning automobiles could be grouped 
together. In addition, individual pages of Web sites could be listed. Thus, there could be a 
three-level hierarchy.) 

2. It would allow the advertiser to input identification information about an ad— for 
instance, its URL. This will tell the sofhvare that the information given will apply to that 
particular ad. 

3. It would allow the advertiser to indicate which Web sites he would like to have 
display his ad. If Web sites are grouped by subject matter and/or individual pages are listed, the 
advertiser should be able to indicate choices on those items, too. 

For instance, a check box could appear next to each item. If the advertiser clicks a 
checkbox for an item which has subordinate items (for instance, the user may have clicked on 
the checkbox for a Web site which was listed with its individual pages) then the checkboxes for 
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the subordinate items could be automatically -checked" or -filled in" by the software. (Java or 
JavaScript could be used to do this in -real-time" instead of requiring the user to sumit the 
form.) But a number of other mechanisms could be used instead of checkboxes-for instance the 
hstings could change color to indicate having been chosen. Checkboxes are probably preferable 
though, smce their meaning is so intuitively clear. 

4. ^P««>na"y.«»«re could be a page that would work the opposite way It would 
allow an advertiser to identify a particular ad. and then it would allow him to specify the sites 
(subject groups, pages) which have Smart Ad Boxes but which he would rather not allow to 
show his ad. Thus, his ad would be distributed to all pages with Smart Ad Boxes except those 
that were specified. Again, pages could be specified by means of checkboxes at page, site or 
subject matter levels. 

5. In the above, whenever a page is listed, it should optionally be possible to chck 
on the listing to be transported to that page in order to investigate it. 

6. Optionally, advertisers should be able to retrieve the information already entered 
for a particular ad. For instance, an advertiser may change his mind about showing an ad on a 
given site. So. by specifying the ad's identifier, the advertiser should be presented with a listing 
of pages which indicate the choices he has already made; ideally, he should be able to change 
those choices using the same techniques used to enter those choices originally-for instance, by 
dickmg on the checkboxes. 

^ Through the pages described above, an advertiser would be able to specify the 
pages which will be allowed to display the ad. However, the Web sites with Smart Ad Boxes also 
need to have a choice. So a page could be set up for them which listed all the ads which they are 
aUowed to show. As in the other case, checkboxes could be used to indicate which ads will be 
chosen; again as in the ..ther case, the webmaster should be able to indicate either the specific 
ads he wants to present on his page (automatically disallowing the rest) or the ads he doesn't 
want to present (automatically including the rest). 

8. As in the other case, allowed ads could be presented hierarchically by subject 
matter, with checkboxes at both levels. 

9. The ad listings could, optionally, consist of the ad banners themselves 
Alternatively, they could be "homnked" text that the webmaster could dick on to be 
transported to a page containing the banner (which might additionally have other information 
supplied by the advertiser about the ad). There should optionally also be a way for the 
webmaster to visit the site that the banner will be linked to; this could be accomplished simply 
by hothnkmg the banner to the site, just as will be the case for users. It could also be 
accomphshed other ways, including having a button, next to the listing for the ad. which is 
hotlinked to the related site. 

10. Alternatively, the system could work the opposite way. Instead of enabling 
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advertisers to offer ads to chosen Web sites, the process could start with Web sites offering 
pages to advertisers, which could then choose which pages they want to accept. 

11. In cases where hierarchies are displayed, the hierarchies could be collapsible, 
similar to the way files ;ire listed in the Finder of Macintosh's System 7 operating system when 
View is -by Name." This would enable people using the lists to navigate them more effectively, 
especially if the actions for expanding and collapsing hierarchy levels were very fast. To achieve 
a quick and responsive user interface, a Java applet could be written which handled some or aU 
aspects of the user interaction. 

Control features for users. 

Demographic data. 
Web pages can optionally display a hot link to a site where users can enter their 
demographic data. Users can optionally be given the ability to modify their demographic data at 
any time. Finally, if they wish to. they can optionally be given the ability to delete their 
demographic data at any time. 

This control over their demographic data wiU alleviate many user's privacy concerns. 
In addition, users should have easy access to information stating how the demographic 
data is used, and who has access to it. 

It will probably be the case that some users will have less concern about privacy issues 
than others. The Web si';e that allows users to update or delete their demographic data could 
optionally also allow users to specify a chosen level of privacy. For instance, some users might 
wish to allow companies to have access to their demographic data in order to receive certain 
special offers (which could be made by direct mail, email, or other means). OptionaUy. there 
could be list where users could choose companies which will be allowed to have access to their 
information. For instance, a check box could appear next to each company name. As described in 
the section of this document which discusses the means by which Web sites would choose 
advertisers, users could choose companies by means of a hierarchically-organized Ust. grouped 
by product category. Again, the hierarchies could be collapsible in order to increase ease of 
navigation. Of course, the companies could alternatively by listed in some other manner, such as 
alphabetical order. 

Users can be induced to suppfy such data by special offers such as discounts on selected 
merchandise. 

Tracking Data. 

Users can optionalfy be given the ability to tell the system not to store their tracking 
data. (If the user electee! not to be tracked, the system would have to decide what ads to display 
based on other means, such as domain type (EDU. NET. etc.). browser and computer types, 
demographic data that had been obtained, etc.) 

Storing data on user's machine instead of in a central database. 
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As still another option, it would be possible to store the tracking data only on the user's 
own machine, so that the data would be completely privateu.t would never have to be compiled 
on another machine. 

This means thRt the criteria normally used by the system to decide which ads the 
will see and the order these ads will be displayed in will have to be sent, across the Internet 
into the user's computer; decisions about the ads will be made there. 

Let's refer to a user who has elected to store his tracking data locally as Sam. 
For instance, to make use of ACF (discussed elsewhere in this document), the tracked 
history of various users (or some subset of that information) wiU have to be accessed by (in 
other words, sent to) Sam's computer. (This data would, of couree. be sent without any 
identifying information that would enable the sender to learn what individual was associated 
with what tracking data.) Software running on Sam's system could then decide which of these 
users are most similar to Sam. and make subsequent dedsiom^ about which ads to disphiy for 



Sam. 



To make the process of sending other user's tracking data to Sam more efficient, the 
system could optionally be designed so that simUar users were grouped into statistical clusters- 
all the people in one duster would be more similar to each other than to people in any other 
cluster. 

Then, information describing the dusters could be sent to Sam's madiine. whidi could 
dedde whidi duster Sam was in. A variety of different types of information could be sent to 
Sam's madiine describmg ead. duster. For instance, the average amount of time spent on ead, 
tradced Web site, where that number is computed firom the data corresponding to all users in 
the duster, would be a good candidate. For eadi duster, this number could be sent for every 
tradted page (or for only a subset of the tracked pages, whid. could be diosen. for instance, for 
their statistical significance). Then, software running on Sam's madiine could determine how 
dosely eadi duster matdies Sam s activities; Sam would be considered to be in the duster he 
matches most dosely. 

Alternatively, instead of sending information about eadi user or duster into Sam's 
computer, information could be sent about the demographics whidi apply to eadi ad. These 
demographics could be suppUed to the system by the advertiser or ad agency, or could be 
determined by a central computer by means of ACF as described elsewhere in this document. 

Since Sam's information would only be stored in his own computer, he would not have as 
many privacy concerns with regard to inpuUng demographic information. So there is a good 
likeUhood that he would be willing to supply sud, information. If he did so. the system could 
optionally not store his tracking information. 

So. to determine whidi ads to display for eadi user and with what frequency and when, 
the software running on Sam's system could simply see how closely each ad matches his 
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demographic data. 

Optionally, every time Sam dicks on an ad, his demographic information could be sent 
to a central database, where it would be used to analyze the overall demographies of people who 
click on the ad. However, no identifying information for Sam need be sent or stored. 

The technique of storing all tracking date on Sam's machine could be implemented, 
using technology available at the end of 1995. with Netscape's protocol for Inline Plug-Ins. 
Inline Plug-Ins. unUke Java applets, have the abUity to write directly to the user's hard disk. 
(The situation for Java applets may change in the future, and other technologies may emerge 
that can accomplish the same purposes.) This ability is essential for storing the user's data. 

The Inline Plug-In could, if desired, handle aU functionality of displaying the ad. 
determining what ad to show, and reading and writing the relevant information from and to the 
hard disk. Otherwise, this functionality could be divided the between the Inline Plug-In and 
other software, such as Java applets. 

A separate application could be written, which the user could download, to manage his 
demographic information on his hard disk. This program could contain the user interface that 
would enable him to easily update the information. 

Security note: 

No matter which of these methods is used, the cookie mechanism provides a very high 
level of security. A user's randomly generated cookie is stored on the user's machine; and that is 
the one and only way information stored on a central datebase is associated with that user. The 
cookie mechanism is such that only programs with the same domain name as the one that 
created the cookie can read or modify it. So while the system's central server machine can track 
a user by means of the cookie, a program existing under a different domain name will not be 
able to access the cookie at all. 

Moreover, there is no need to store user-identification information such as emaU 
addresses (or phone numbers or postal addresses, ete., ete.) on the central system. So there is no 
way the company running the system wiU have the abiUty to do anything to intrude on the 
user's privacy. For instance, there would be no way that the tracking or demographic 
information could be sold as the basis of a maihng list (emaU or otherwise). The fact that such 
identifying information does not need to be stored in the database is a key feature of this 
invention. 

Tracking users. 

There are a number of possible ways to track users. Some will be presented here: 
1- Tracking by means of code on participating Web sites. 
Each Web page which conteins a Smart Ad Box will contain code, which may be 
comprised of HTML, Java, or other languages, which wUI allow a user to be tracked. (This code 
may work in conjunction with other software, such as Netscape-style Inline Plug-Ins.) In 
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addition, such means for tracking a user can be embedded in pages that do not themselves 
du^^ay advertising. Pages which have the ability to cause a central database to be updated with 
tracking informaUon will be referred to in this document as "tracking-enabled.- 

Every time a user visits a tracking^nabled page, a central database will be updated 
to show that that particuhu- user visited that page. Optionally, the length of time spent on the 
page, or other such information, can also be stored. 

One way to perform this update will be for the page to reference a CGI script which 
exists on the machine containing the central database. This CGI script, which can be written in 
languages such as Peri. C. Basic. AppIeScript. etc. would perform the database updates 

AJtematively. a CGI script can exist on the machine which is hosting the page To 
perform updates, it would communicate over the Internet with a program which exists on the 
machine hosting the database. 

Some types of information that an embodiment of this invention could choose to store for 
each user: 

An identifier of the page the user visited. 
• The length of time spent on the page. 

The amount of money spent by the user while visiting the page (or 
site^-this would be useful for Web sites that are retail stores. 

The identifier of the ad displayed for the user in the smart ad box. 
Whether or not the user clicked on the ad. 

Whether or not the user rejected the ad (mentioned in an eariier section 

of this document). 

An identifier of each particular item purchased-for instance, the ISBN 

of a book. 

There has to be a mechanism for re-identifying a user from session to session. 
The preferred embodiment involves using the Netscape Navigator s cookie mechanism 
This will allow us to accurately track the 70% to 80% of Web users who use the Netscape 
product. In addition, it will work with any Web browser that has a cookie mechanism 
compatible with Netscape's. It is likely that the vast majority of Web browsers will, in time 
have such compatibility. The preferred way to use it is as follows: 

Each time the user references a tracking^nabled page, a CGI script is executed This 
CGI script, referred to in this document as the Tracking Script, is referenced by each 
tracking-enabled page: that is. all tracking-enabled pages, which may be spread out over many 
different host machines, will all call the same Tracking Script which exists on just one machine 
or networked group of machines accessible through the one URL. (It is necessary for the 
Trackmg Script to exist under just one domain tail in order to receive the cookie no matter 
which page the user is on. A CGI on a machine with a different domain tail will have no way to 
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access the cookie.) A domain tail consists of the "tail end" of the domain name such that the 
included portion contains at least 2 or 3 periods, depending on the particular top-levol domam. 
For more on this, sec NeUcape's technical note on the Web at 

httpy/www.netscape.com/newsfef/std/cookie_spec.html or any other documentation on Netscape's 
cookie mechanism, which is a public protocol that any competent practitioner is famUiar with. 

Alternatively, a set of Tracking Scripts could be made available, all under the same 
domain UU, such that a particular participating Web site could interact with one of these 
routines. For instance, there might be different properties associated with the different Tracking 
Scripts— for instance, in cases where the Tlradcing Scripts also draw the Smart Ad Boxes, 
different Tracking Scripts might draw Smart Ad Boxes of different sizes. Again, it is essential 

that all of these Tracking Scripts be under the same domain tail in order that they can all 
access the cookie. 

The Tracking Script will examine the cookies passed to it to see whether one of them is 
the Tracking Cookie. 

If it did receive the Ttadcing Cookie; 

then this cookie will contain the identifier of the user; the central database can then be 
updated with the ID of the user and of the current page, and, optionally, other information such 
as the time spent on the page. 

OptionaUy, the expiration date of the Tracking Cookie could be updated; for instance, it 
could always be set to one year after the last Tracking Cookie access. 
If it did not receive the Tracking Cookie: 

then it creates it. The value of the Tracking Cookie could be generated using a random 
number generator; one of many other alternatives would simply be to pick a number one greater 
than the last value generated. 

The Tracking Cookie is then stored on the user's machine using the Netscape cookie 
mechanism; each time from then on that a user visits a tracking-enabled page, the stored 
Tracking Cookie will be used to re-identify that user. The Tracking Cookie should be assigned 
an expiration date so that it doesn't disappear when the user leaves. The expiration date could 
be, for instance, one year in the future. 

Note that the Tracking Cookie wiU not allow anyone to intrude on the user's privacy ly 
sending him email or by any other means. There need be no way to associate the Tracking 
Cookie with the user s name, physical location, or any other personally-identifying information. 

The techniques invohred in writing these CGI's are known to any competent practitioner 
of Netscape-related CGI programming. 

There are other ways to track users, such as using environment variables such as 
REMOTE.ADDR. REMOTE.HOST, REMOTE JDENT and the header field HTTP_FROM. 
These are known to any competent practitioner of CGI programming. Moreover, other methods 
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Will probably become practical in time. So the cookie mechanism is not required, but does have 
advantages 

2. Tracking by means of software that runs on the user's machine 
whenever he is browsing the Web, 

The problem with tracking by means of code on participating Web sites is that it only 
enables users to be tracked while they are visiting participating sites. So the amount of 
information that can be gathered is limited in that wny. 

It would be much better to be able to track all sites visited by a user. 

The challenge is to get the code that does this tracking into the user's machine Users 
don't want to manuaUy download software unless they clearly understand that there is a 
fundamental benefit in it for them. 

It might be thought that a Java applet would be the perfect means to track user 
actnnty over time. But current implementations of Java automatically Oush Java applets from 
the cache whenever the user moves to a domain other than the one the Java applet originally 
came from. So Java currenUy has limited usefulness for this purpose. 
Alternatives: 

BttUding tracking code into the Web browser itself. 
Probably the ideal methodology would be to build the tracking code into the Web 
browser itself. In fact. Web browsers do already have some tracking code buUt-in; for instance 
the Netscape Navigator has a "Go" menu which lists sites previously visited in the current 
session. This information is lost, however, when the user Quits Netscape Navigator. 

A Web browser could automatically open up a socket for communications with the 
central database. At intervals, it could send tracking information to the central database 
without any participation on the part of the user. This information could include, for example, 
the URL of each page visited and the amount of time spent there. 

The only real drawback to this technique is that it requires the participation of the 
companies which create the browser software. 

Tracking the user by means of software running on the user's machine 
simultaneously with the bnnvser. using software that has no user interface (or a minimal user 
inteiiace). 

The user could download an appUcaUon or other type of software (such as a 
Madntosh-style control panel or system extension) which could track his activities and 
communicate them to the central database. 

This software could operate with the cooperation of the Web browser. For instance, the 
Netscape Navigator allows user activities to be communicated to separate applications; on the 
Macintosh, this mechanism is based on Apple Events. 

To motivate the user to download this software, an incentive could be given. For 
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instance, the user could be offered a great deal on an advertised prodoetiior promised a number 
of such great deals in the future. In fact, users could even be paid to download the software. 

Tracking the user by means of software running on the user's machine which is 
of its own benefit to the user, separate from its tracking functionality. 

It would be best if users could be motivated to download the tracking software without 
being offered special deals or financial rewards. For this to be the case, the software has to 
provide some benefit of its own. 

One example of this would be a Screensaver. Screensavers typically run aU the time, 
although they only take over the screen when the user is inactive. 

A Screensaver that had some desirable properties compared to other screensavers 
avaUable in the marketplace, and tbat^as inexpensive or free of charge, would be likely to be 
downloaded from the Web by quite a few usns. 

One way that such a Screensaver could differentiate itself from other current 
Screensaver products is by means of its abiUty to communicate over the Internet, which is 
required for its tracking functions. 

For instance, this Screensaver could be designed so that it could display HTML and/or 
execute Java code. In fact, it could have much of the functionality of a Web browser. (Or, it 
could use its own protocols for displaying images and text on the screen, dififerent from those 
used in Web browsers. However, it would probably be best for it to use standard protocols.) 

Thus, companies and individuaU could provide content for this "Internet Screensaver." 
Users could choose the LTRL they want to be connected to. for instance, by means of a menu that 
was automaUcally updated to show all URL's which supply Internet Screensaver content. 
Alternatively, the list of URL's could be in the form of HTML or Java output displayed on a 
Screensaver page. Or a dialog box could be used. etc. (The list of such URL's could be 
communicated from a central site across the Internet.) 

An example of content that would motivate many users to download the Internet 
Screensaver would be a continuously updated stock ticker. A couple of other examples would be 
continuously updated news headlines or weather reports. A further example might be showing 
the status of the user's email box. 

Continuously up.iated content would only be possible for users with continuous Internet 
connecUons. That situation currently is common in office situations, but not in home situations. 
Of course, it is quite possible that that situation will be changing in the future. For instance, 
cable companies may in the relatively near future offer continuous Internet connections at an 
inexpensive price. 

For users without continuous Internet connections, however, semi-continuous content 
could be made available. For instance, the software could enable an Internet connection for a 
brief period in every hour (or other interval) during which news headlines, weather, stock 
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The problem with this technique is that there is currently no automated way that a 
Web site can acquire the content of a user's bookmark file. 

A Java applet would be a candidate, except that security restrictions currently 
prohibit Java from reading files on the user's hard disk. Lifting this restriction in the case of 
bookmark files would solve this problem. 

• Another way to track users is the following: 

Code can be provided to a number of Web sites that enable them all to access the same 
central database when a user logs in, enabling the user to use the same user ID and password 
on many different Web sites and potentially frying each Web site from the need to have a 
database for checking whether each user had already registered. This code can update a central 
database to show which participating sites have been accessed by each user. 

Ease of implementation. 

It would be valuable for embodiments of this invention to make it very easy for Web 
sites to participate. 

To do this, a Web site (or, perhaps, a page or set of pages) should be made available that 
contains complete instructions on how to set up a participating page. Instructions should 
explain how to place a Smart Ad Box on a page, as well as how to enable the tracking of users 
on a page (if the embodiment involves separate code for tracking and for the Smart Ad Box). 

The code could be designed in such a way that there need be no direct communication 
between the people supplying the Smart Ad Box service and related services and the people who 
want to enable their Web site to participate in those sendees. Any competent practitioner could 
design such code. Furthermore, it should be designed in such a way that the modifications 
required to enable a Web page to participate are minimal. Again, any competent practitioner 
could design such code. 

Thus, an instructional site would enable participation in the service to grow rapidly. 
Web sites could very easily become participants on a trial basis. 

It is an important consequence of this invention that relatively small Web sites (small in 
tiie sense of a relatively small number of daily visitors) will be able to become participants. 
Because no human involvement is required on the part of the company supplying the Smart Ad 
Box and related services, there is much less of a barrier to the involvement of these small sites 
in advertising. Normally, the manpower associated with making agreements between individual 
advertisers and ad agencies and individual Web sites is prohibitive enough that no such 
agreements are made with small sites. Thus, this invention will enable many small sites to earn 
money from displaying advertising. The largest expense involved in dealing with an individual 
participating Web site might be the expensive of writing and mailing a check; of course. 
Internet banking may soon lower that cost. 

Optionally, the Web site discussed in this section (or a separate site) could allow 
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participating Web sites to detennine the amount of money they have earned to date bv virtue of 
their participation. (It is expected that advertisers will pay the company offering Smait Ad Box 
and related services, and that this company wiU pay the participating Web sites.) 

For instance, each participating site could have an identifying code and/or password 
which they acquire through interaction with the instructional Web site or some other Web site 
Tlie participating sites themselves could choose their ID codes and/or passwords, or they could' 
be assigned by the software. 

(It is possible that this same ID code could be Wcoded." or directly incorporated, into 
the code on a participating Web page which calls the Smart Ad Box CGI in ortler to identify the 
ate. The instructional site would, of course, explain how to do this.) 

In an embodiment where advertisers have ID codes and/or passwords, they should be 
able to go to a particula.- page and type in that information, and. in return, be enabled to see 
the amount of money they have earned to date. 

(Alternatively, instead of using ID codes and passwords, an embodiment could identify 
companies by other means, such as checking a cookie on the dient machine or simply allowing 
compames to type in the company name.) 

Moreover, in the one embodiment. Web sites who would like to become paid participants 
would be able to accomplish everything needed online, without manual intervention. This would 
save considerable money, and make it even more practical to allow smaU Web sites to 
participate. 

In other words, there would be a Web page with (possibly among others) the following 
attributes: 

Prospective participants could input (or receive a generated) ID code and 
a password. Of course, the system would check to make sure that this ID code was not already 
in use by some other company. 

Prospective participants could input whatever information is required for 
payment: for instance, if physical checks are to be sent through the mail, this information would 
mdude the address and the name to make the check out to. 

Then, based on the above information, the system could automatically cause payment to 
be made. Checks could be printed, or funds transmitted by electronic means, all with no (or 
minimal) human intervention. 

in order to keep expenses down, the system could optionally be programmed not to send 
a payment until the money owed to the partidpating sound exceeded some preset amount This 
way. the expense of sending the payment will only be a small percentage of the funds involved 

It must be stressed that there are other ways of enabling customers to input the 
.nformauon discussed in this section. For instance, multiple Web pages could be involved in the 
.nput process, or. as just one more example, if the embodiment in question involved telephone 
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communications, part or all of the input process could occur by means of pressing the keys on a 
touch-tone telephone. (Of course. Web page input is based on hardware such as a video screen, 
keyboard, random access memoiy. etc The techniques described here are a method for enabling 
this hardware to achieve the desired ends.) 

It should also be noted that the techniques described in this section are also uselul for 
advertising systems tha«. do not involve automated collaborative filtering; as one example, 
consider a system that simply uses demographic information supplied by the individual users in 
order to decide which ads to display to whom. Such a system could use the techniques described 
here to enable Web sites to participate without human intervention, again leading to the cost 
savings which would make it very practical to allow very small Web sites to participate. 

It is of significant value to enable these smaU Web sites to participate, because a large 
amount of the time of many who use the Web is spent visiting such small sites. Making that 

space available for advertising adds significanUy to the potential revenue stream. 

Automated Collaborative Filtering 

ACF is a field of research which has been receiving attention in recent years from such 
organizations as BellCore and the MIT Media Lab. I myself devoted 18 months over the last few 
years to research in this area. An MIT Media Lab spinoff company called Agents, Inc. has a 
Web site which uses this technology for making personalized recommendations ofmnsic CD's. 
Upendra Shardanand's 1994 Massachusetts Institute of Technology (MID Media Ub Master's 
Degree thesis. entiUed Socio/ Information FUtering For Music Reeommendation (hereby 
incorporated by reference) is a good write-up of tiieir basic technology. 
The basic idea, as applied to Smart Ad Boxes, is as follows. 
Suppose we want to decide whether a particular ad is likely to be of interest to a 
particular user. say. Joe. We want to use automated collaborative filtering; we may be using 
this technique in addition to other methods for matchings ads to users. 

First, we need to decide which other users are similar to Joe in their interesti>. A list of 
similar users can be stored in the database, or can be generated "on the fly." IdeaUy. we would 
also compute a number representing the degree of likely simUarity of interestis. In fact, the list 
of simUar people can be based on tiiis number for example, the most simUar person to Joe is at 
the top of the Ust. and each successive entry displays less similarity until some cutoff point is 
reached, beyond which people aren't added to the list. 

To compute these degrees of simUarity. we need datii. This data will involve the 
information we have stored in our dabibase by u-acking each user over time. (Optionally, it 
could also involve other information such as demographic data supplied by the user; but by not 
relying on such data, we eliminate the need for the user to actively participate in this process in 
any way.) 

From our datiibase. the system "knows" which Web sites Joe has visited, and. possibly. 
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One interesting aspect of this technique occurs if Joe's interests are apical for his 
demographic group. For instance, some people in their 50's have interests that are more 
common for people in their 30's. Thus, the technique described here may incorrectly come to the 
conclusion that Joe is in his 30's when he's really in his 50*s— but that erroneous conclusion 
would actually lead, in this case, to a better targeting of advertisements. If Joe^s interests are 
closer to those of a person in his 30% then ads directed to that age group are the ads that are 
most likely to be of interest to him. 

Of course, this also applies to users who have supplied some, but not all, of any 
requested demographic data. This should not be construed to mean that my invention ONLY 
involves making extrapolation about demographics by means of such ACF techniques as were 
explicitly mentioned in the documents, such as John He/s and the MIT Media Lab's 
(Shardanand's). It also includes making extrapolations based on other versions of ACF, some of 
which may have very different degrees of sophistication from the mentioned ones. 

• Whether or not the users supply demographics* there are a number of 
possible "pure ACP approaches, some, but not all, of which will be discussed here. 

o One approach: 

For every ad. we can consider the list of people who are similar to Joe. and compute the 
ratio of clicks to impressions. For example, if there were a total of 1000 impressions, and 10 
people clicked on the ad. the ratio would be WIOOO or 1/100. (An impression is one showing of 
an ad to a person.) 

This ratio provides a very rough measure of the interest of people on the list in the ad. 
The greater the ratio, the more interest is indicated. 

Therefore, the ad with the highest ratio would be considered to be the one most likely to 
be of interest to Joe; the ad with the second highest ratio would be the one second most likely to 
be of interest; etc. 

These ratios could thus determine the frequency with which the system chooses to show 
Joe the various ads. 

o Another approach: 

For each person on the list of people similar to Joe. we see how many impressions of a 
particular ad were required before he clicked on it. We assume that that number is related to 
the probability he had of clicking on an ad during a given impression. For instance, if he had 10 
impressions before cUcking on the ad, we might assume that P = yiO. If he never clicked on the 
ad. we would assume P = 0. 

So. for each user, and for each ad. we will have a value for P. If we average these values 
together for each ad. well have an average P for that ad. and can use that to determine which 
ads are more likely to be of interest to Joe. 

Now. we showed earlier that it is possible to compute a numerical measure of closeness 
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to Joe. These measures could be used as weights. Instead of doing a simple average, we can take 
the weighted average of all the users, where the weights are determined by each user's 
closeness to Joe. 

One could use the closeness measures direcUy as weights. Alternatively, they could be 
transformed. Shardanard's thesis gives some methods for transforming similarities to weights 
that have proven to be cfTective. 

Genetic programing could be used to evolve algorithms to transform the simUarities to 
weights. The fitness function would be the algorithm's success in predicting which ads ate of 
interest to Joe. For purposes of the genetic programming pnicess. the fitness function would 
measure how good a particular algorithm is at "predicting- how interested Joe was in ads that 
he has already been exposed to, and where we have already counted how many impressions it 
took him to click on them. 

Other methods for determining weights can be generated by trial and error or by other 

means. 

A more stati.Htically sophisticated approach: 

Again, we only consider the people who are similar to Joe in taste. 

We wUI again compute the ratio of clicks to impressions. Call it R. 

For each ad. there is a probability P that people as similar in taste to Joe as those on 
the list will dick on it in a given exposure. 

P. not R, is the number we're really interested in. R is just a rough estimate of P. The 
reason for this is that we only have a Umited amount of data available to us; if we had an 
unlimited amount of data. R would be the same as P. 

We can't compute P exacUy, but we can find P^ such that we can reject the nnU 
hypothesis that P < P^ with a confidence level of A. which might typically be 0.05. (In other 
words, there would only be a 5% chance that P < P^.) Thus. P,. as opposed to R, is a number 
that we can have a known degree of confidence in. 

There are a number of different approaches for computing P^. One of these uses the 
cumulative binomial distribution together with a search algorithm. In one embodiment, the 
search algorithm successively tests possible values for P^ at certain fixed intervals, for instance, 

0.01. 0.02. 0,03 0.99 until it finds the greatest P^ such that we can reject the null hypothesis 

that P s P^ With confidence level A. In another embodiment, a binary search mechanism is 
used to accomplish the same goal more quickly and/or accurately. Well refer to the chosen 
search algorithm as SO. Let CO be the cumulative binomial probabiUty distribution function. 
(One is described in Press. Teukolsky. Vetteriing. and Flannery 1992. Numerical Recipes in C. 
2nd Ed., (Cambridge, England: The Cambridge University Press) p. 229; the relevant sections 
are hereby incorporated by reference.) 
The inputs to a) will be: 
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1. An assumed value for P; these assumed values are generated by S() in 
order to see how consisUnt or inconsistent they are with the evidence. 

2. The number of impressions of the ad (that is. the number of Umes people 
were shown the ad). From a statistical point of view, each impression is considered to be an 
experiment 

3. The number of clicks on the ad in question. From a statistical point of 
view, each click is considered to be a success in the experiment 

a) wai calculate the probabiUty that the presented combination of (2) and (3) (or a 
greater number of successes) could have occurred by chance alone given the assumption of (1). If 
this is a low probability, it's unlikely that the assumption is correct 

SO wai repeatedly call «) with different trial values for P, untU it finds one (P^) such 
that the the calculated probability is A. If we have chosen a low A. then this would imply that 
we can confidently reject the hypothesis that P S P^ 

Then a relatively high value P^ for a particular ad will mean that that is an ad we can 
be confident that Joe will be interested in. So P^ can determine the order in which we present 
the ads: they are presented in reverse order of P^. 
Still another approach: 
An approximate value could be found for P^ by means of a neural network. (The neural 
network could be trained using P^ as computed above.) This would have advantages over the 
previous approach in execution speed. 

Alternatively, genetic programming could be used to evolve an algorithm that outputs an 
approximation to P^. 

• The results of the previous two approaches could be computationally 

combined. 

For instance, if the system orders the ads by using demographic data and also orders 
the ads using a "pure ACP approach, such that the most appropriate ads for a given user come 
first then the two approaches could easily be combined by calculating the average position for 
each ad. In other words, the ad mightT)e the nth ad in the demographic-based ranking and the 
mth ad in the "pure ACF" ranking; the combined rank could be (n + m) / 2. 

There are an infinite number of other computational ways to combine the two 
techniques; very many of which could be constructed by any competent praetieioner. 

• combination with such approaches as are described in this section, 
cluster analysis can be used. 

Instead of comparing Joe to each individual user, we can compare Joe to clusters of 
similar users. These clusters will be comprised of individuals with similar demographics and/or 
tracking histories. The degree of similarity between people wiU be computed as described above; 
in each cluster, each individual will be more simiUr to people in his own cluster than to people 
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in other clusters. 

Such an approach can be more computationally efficient, since Joe would only need to 
see which cluster he is associated with, rather than comparing himself to all (or a substantial 
subset) of the set of individual users. 

Most ads will be more of interest to people in some clusters than otheiB; this can be 
determined by techniques such as those described above, but applying those computations (such 
as the cumulative binomial distribution) to clusters rather than to individuals. 

One other aspecT. of using ACF to decide which ads to show to which users should be 
noted here. The system has to collect data on a number of users which shows whether or not 
they responded to particular ads. Then. when, for instance, the system needs to compute the 
pnonty with which we should consider showing a particular ad to Joe. it finds users with 
similar profiles to Joe and who it has knowledge about whether or not they responded to the ad 
But this creates a cbickon^r-egg situation; when an ad is new. there won't be any users who 
have already been expooed to the ad, so the system will be unable to find users who are similar 
to Joe and who it has prior knowledge about with respect to that ad. 

So. for each new ad. there wUI have to be a period when ACF techniques are not the sole 
determinant of which ad is displayed; instead, such ads will be displayed either according to a 
fixed schedule or randomly. Moreover, a particular embodiment of this invention could also 
choose to continually have a probability that the ad shown a user at any given time might be 
randomly chosen rather than chosen by ACF. There is a tradeoff heretithe more ads are 
randomly presented, a) the more data the system will be able to collect for the ACF engine, 
increasing the accuracy of the engine; and b) the more frequenUy users will be exposed to ' 
random ads that are not relevant to their interests. 

The desired proportion of displaying ads according to the ACF output relative to 
displaying ads randomly or according to a fixed schedule can be determined by measuring such 
factors as overall system-wide number of responses to ads in a given period of time (which 
should Ideally be high) and poUing users on their satisfaction with the system. A mathematical 
analysis could also be used in predicting the best proportion. A sunple and sensible starting 
pomt would be to simply assign 10% of viewing time to randomly chosen ads. 

The various steps described hereinabove are desirably implemented by programming 
them into functions incorporated within Web Server software or in application programs used in 
conjuncuon with such software. Programmers of ordinary skill in the field can implement them 
using customary programming techniques in languages such as C. Visual Basic, Java Peri C++ 
and the like. 



-22 - 



PCT/US96/20429 

CLAIMS 

Having thus described the invention, what it is desired to claim and thereby protect by 
Letters Patent is: 



1. An automated system in an interactive communication medium for selectively 
displaying advertisements to a subject comprising: 

means for determining the subject's community through a collaborative filtering 
technique, using information derived from the activities of the subject in the interacthre 
medium, and 

means for determining which ads to show the subject based on characteristics of the 
subject's community. 

2. The system of claim 1 wherein the interactive medium is the World Wide Web and 
wherein the information derived from the activities of the subject in the Worid Wide Web 
comprises information selected from the group consisting of: 

the identity of Web sites the subject has visited, the frijquency of such visits, the nature 
of the content at those sites, the identity of items purchased, the prices of items purchased, 
ratinp supplied by the subject, the selection of Web ads the subject has chosen to view further 
infonnatioii about, and the selection of Web ads in which the subject has indicated disinterest; 

said system further comprising means for recording said information in a tracking 
database. 



3. The system of claim 2, wherein said means for recording such information in a 
tracking database includes cookies which are stored on a fixed memory in the subject's computer 
under CGI control. 

4. The system of claim 2, wherein said means for recording such information in a 
tracking database includes software running on the subject's computer. 

5. The system of claim 4 wherein said software running on the subject's computer, said 
software being selected from the group consisting of an in-Une plug-in. a screensaver working in 
conjunction with a Web browser, and software incorporated in a Web browser. 

6. The system of claim 1, wherein the means for determining which ads to show the 
subject based on characteristics of the subject's community includes means for displaying a new 
ad for a training period and means for determining whether a high or low proportion of the 
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members of the subjecf s commuiuty have chosen to view further information about the ad. 

7. nie system of claim 1. wherein the means for determining which ads to show the 
subject based on characterisUcs of the subject's community includes means for associating a 
demographic profile with the community and means for associating a demographic profile with 

specific ads. 

8. The system of claim 1. wherein the means for determining which ads to show the 
subject based on characteristics of the subject s community are embodied in software running on 
the subject's computer. 
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